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abstract 


Automatic  computer  determination  of  object  boundaries  has 
attracted  many  researchers  in  the  various  areas  of  image  processing 
for  some  time.  The  concept  of  boundary  determination  is  basically 
motivated  by  problems  in  textural  analysis  (a  subject  in  scene 
analysis)  and  robotics  (a  subject  in  artificial  intelligence). 

In  this  dissertation,  an  object  boundary  estimator,  applicable  to 
a class  of  noisy  images,  will  be  introduced.  The  images  considered 
will  contain  an  object  of  interest  within  the  background.  The  boundary 
estimator  will  be  designed  based  on  the  existing  estimation  techniques 
through  certain  available  statistics  of  the  object,  background,  noise, 
and  the  boundary.  Extensions  of  the  estimator  to  multi -object  images 
will  be  discussed  as  well.  The  procedures  developed  will  be  recursive 
and  readily  implementable  on  a digital  computer.  A few  examples  will 
be  considered  to  illustrate  the  performance  of  the  estimator. 
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Chapter  1 
INTRODUCTION 


In  visual  perception,  among  the  most  effective  stimulus  configur- 
ations are  the  "edges"  outlining  the  objects  within  an  image,  I*1,2]  • 

This  has  motivated  many  researcVers  in  the  areas  of  automated 
image  processing,  specifically  those  in  scene  analysis,  to  develop 
various  techniques  of  edge  detection  and  boundary  determination. 

An  incentive  for  research  in  scene  analysis  is  the  study  of 
robotics,  [3],  The  available  information  about  the  shapes  and  sizes 
of  physical  objects  constitute  the  total  visual  intelligence  required  by 
a robot.  Such  informations  can  be  provided  through  knowledge  of 
object  boundaries. 

Defining  the  set  of  points  which  separate  the  object  and  background 
as  "object  boundary,  " the  purpose  of  this  report  is  to  develop  a re- 
cursive, easily  implementable,  estimator  to  yield  an  estimate  of  the 

object  boundary. 

In  preparation  toward  that  goal,  a survey  of  the  existing  bound- 
ary determination  techniques  is  made  in  Chapter  II.  It  will  be  shown 
that  present  techniques  are  generally  based  on  image  models  repre- 
senting overall  image  brightness  functions.  An  image  model,  labeled 
as  the  "replacement  processing,  " will  be  defined  which  considers  not 
only  the  intensity  details  of  the  image,  but  also  explicitly  contains  ^ 


the  boundary  information  within  the  image. 

In  Chapter  III,  the  replacement  processing  model  will  be  utilized 
to  formulate  a boundary  estimator  for  a certain  class  of  images.  The 
images  considered  will  contain  an  object  of  interest  within  a back- 
ground. The  boundary  estimator  will  be  designed  based  on  a combin- 
ation of  deterministic  and  probabilistic  information  pertaining  to  the 
image. 

Chapter  IV  will  be  concerned  with  the  development  of  possible 
solutions  resulting  in  an  implementable  boundary  estimator.  Re- 
cursiveness of  the  estimator  will  be  our  prime  objective.  A number 
of  examples  will  be  provided  to  demonstrate  the  applicability  of  the 
boundary  estimator. 

In  Chapter  V,  an  analysis  of  the  boundary  estimator,  regarding 
its  performance,  will  be  undertaken.  Extensions  of  the  estimator  to 
multiobject  images  will  be  considered,  and,  areas  with  potential  for 
future  research  will  be  explored. 


2 


Chapter  II 


STATE  OF  THE  ART:  PAST  AND  PRESENT 


A digital  image  is  commonly  represented  by  a two  dimensional 
discrete  function,  b(m,  n),  whose  range  is  the  grey  level  values  of 
the  image  and  whose  domain  spans  the  entire  image. 

In  general,  as  a deterministic  function,  the  image  function 
b(m,  n)  does  not  carry  any  salient  properties  common  to  all  images 
other  than  the  constraints  imposed  on  it  by  image  recording  and/or 
displaying  systems.  Examples  of  such  constraints  are  positiveness 
and  boundedness  of  b(m,  n).  Statistical  representations  of  images 
are,  hence,  in  order. 

Statistical  image  models  are  generally  based  on  the  knowledge  of 
the  mean  and  autocorrelation  functions  of  b(m,  n).  It  ha:  been  shown, 
[4l,  that  two  dimensional,  wide  sense  stationary  random  processes, 
possessing  exponential  autocorrelation  functions  of  the  form 


Eb(m^ , n1  )b(m2,  n2) 


-a|m2-m1  | -$\nz-nl  | 

Me  t 


represent  suitable  models  for  b(m,  n).  The  justification  is  basically 
experimental.  Such  statistical  models  have  been  previously  used  in 
image  restoration  and  enhancement  problems,  [5-7].  However, 
consistant  in  the  results  has  been  the  presence  of  blurry  edges. 
Intuitively,  we  may  conclude,  an  image  model  based  solely  on  the 
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first  two  moments  of  b(m,  n)  might  be  suitable  for  reconstruction  of 
image  grey  level  values,  but  it  does  not  carry  sufficient  information 
to  adequately  reconstruct  the  object  boundary.  This  conclusion  has 
been  our  main  motivation  in  the  development  of  a boundary  estimator. 
A boundary  estimator,  combined  with  the  image  estimators  introduced 
in  [5  and  [7],  would  result  in  an  improved  restoration  of  the  image. 

Along  the  way,  we  became  aware  of  the  importance  of  boundary 
estimators  in  other  areas  of  automated  image  processing  such  as 
scene  analysis  and  artificial  intelligence. 

Before  proceeding  any  further,  a brief  review  of  existing  methods 
in  edge  detection  and  boundary  determination  is  in  order.  For  this 
purpose,  we  have  relied  extensively  on  References  [8]  and  [9], 
because  of  their  elaborate  coverage  of  the  subject.  An  attempt  has 
been  made,  however,  to  provide  the  reader  with  a complete  list  of 
relevant  bibliography  at  the  end  of  this  report. 

In  the  following  sections  (2.  1-2.6),  a description  of  the  basic 
techniques  regarding  boundary  determination  is  delineated.  The  list 
of  bibliography  is  intended  to  be  complementary  to  the  material  cover 
ed,  and  those  not  covered  for  the  sake  of  brevity,  in  Inis  chapter. 

2.  1 Thresholding 

Thresholding  is  the  simplest  method  of  data  extraction.  Basically, 
the  image  function  b(m,n),  representing  the  intensity  (grey  level) 
values  of  the  image,  is  compared  with  two  threshold  values,  Tj  and 
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T . If  T.  ^b(m,  n)  £ T_,  the  grey  level  value  corresponding  to 
b(m,  n)  is  set  to  some  preselected  constant,  b.  Otherwise,  it  is  set 
to  zero.  The  thresholds  Tj  and  can  be  obtained  through  inspection 
of  the  image  histogram. 

A variation  of  this  technique  is  to  perform  thresholding  on  some 
tran  'irm  of  b(m,  n).  High  pass  filtering  of  t^e  image  function 
Fourier  transform  is  an  example.  Since  high  spatial  frequencies  of 
an  image  correspond  to  sharp  edges,  [8],  high  pass  filtering  is  a 
technique  to  extract  boundaries. 

In  general,  thresholding  is  applied  along  with  spatial  differencing 
(described  below)  to  outline  objects  within  an  image.  Its  sensitivity 
to  noise,  and  the  fact  that  threshold  values  differ  from  picture  to 
picture,  limit  the  usage  of  the  technique. 

2.2  Spatial  Differencing:  Noise  Free  Images 

One  method  of  boundary  determination  is  to  locate  the  abrupt 
dark-light  transition  regions  within  an  image.  In  terms  of  the  image 
function  b(m,  n),  such  regions  correspond  to  points  in  the  image 
where  the  gradient  of  b(m,  n)  retains  "large"  magnitudes.  Here,  the 
term  "large"  is  relative  to  an  arbitrary  threshold  value. 

Different  definitions  of  image  gradient  have  been  given  in  the 
literature,  [8,  It)].  The  most  common  is  the  "Roberts  cross  operator," 
R(m,n),  defined  as 

(2.2.1)  R(m,  n)  = b(m,  n)-b(m+l , n+1 )]  +fb(m,  n + 1 )-b(m+l , n)l  . 
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If  a picture  element  with  grey  level  value  Miry  nQ)  belongs  to  an 
edge,  the  magnitude  of  Piny  nQ)  will  be  large;  whereas . « b<"V"o> 
belongs  to  a relatively  uniform  intensity  region,  the  magnitude  of 


R(mQ,n0)  will  be  small. 


,n  practice,  for  computational  efficiency,  a simplified  version  of 
the  above  operator,  namely, 

,2.2.2,  F(m,n)  = |b(m,  n)-b(m+l , n+1 1 1 + |b(m,  n+l)-b(m+l,  n,|  , 

is  implemented  instead.  It  can  be  verified  by  inspection  that  F(m.n) 
behaves  qualitatively  as  R'm,  n).  In  fact, 


(2.2.3) 


R(m,  n)  ^ F(m,n)  ^ & R(m,  n)  . 


The  major  disadvantages  of  this  technique  are  again  related  to 
the  selection  of  an  optimum  threshold.  If  R(m.  n),  or  equivalently 
F(m,n),  is  compared  to  a too  large  a threshold,  some  significant 
edges  will  be  lost.  Similarly,  a small  threshold  will  cause  the 
appearance  of  sparious  outlines.  The  existence  of  noise  in  the  image 
is  another  source  of  restraint  in  boundary  determination  through 
spatial  differencing. 

2.3  Spatial  Differencing:  Noisy  Images^ 

Different  methods  for  reducing  the  adverse  effects  of  noise  in 
boundary  determination  have  been  suggested  in  the  literature.  Typi- 
cal ones  underscore  some  combination  of  averaging  and  differencing 
of  the  noisy  image  function.  Denoting  such  functions  by  ( 


(2.3.  1) 


y(m,  n)  = b(m,n)  + v(m,n)  , 


where  v(m,  n)  represents  the  noise  function,  an  operator  frequently 
suggested  is 


(2.3.2) 


D(m,  n) 


The  parameters  used  to  define  this  operator  are  Wj(m,  n)  and  n^’ 


representing  two  arbitrary  contiguous  regions  in  the  image  with  areas 

A and  A , respectively.  Comparing  D(m,n)  to  a preselected 
wi  w2 

threshold,  then,  will  constitute  whether  the  picture  element  b(m,  n) 
belongs  to  an  edge. 


Choosing  appropriate  region  sizes  for  Wj  and  \v^  is  an  important 
factor  in  construction  of  this  operator.  If  regions  Wj  and  w2  are 
chosen  too  large,  a blurring  of  the  edge  position  will  result.  Too 
small  regions,  on  the  other  hand,  could  introduce  sparious  boundary 

points. 

An  ingenious,  however  ad-hoc,  modification  of  the  above  operator 
has  been  presented  in  [l  1 . Specifically,  let 


S S - 7T 


Aw,  w.  (m,  i.;k) 


y(i,j)|, 


AwJk^  w7(m,n;k) 


(2.3.3)  dk(m,  n)  = 

where  k = 1,2,  4,  8 2* , with  l being  a non-negative  integer 

number.  To  explain  the  notation,  we  resort  to  equation  (2.3.2).  For 
each  value  of  k,  w^m.njk)  represents  a subregion  in  the  image  such 


that 


7 


(2.  3.4) 


(2.3.4)  U w^  (m,  n;k)  = w^m.n), 

k=l 

where  U denotes  the  union  of  sets.  Similarly  for  w^fm.n.k), 


(2.3.5) 


U w (m,  n;k)  = w^m,  n)  • 
k=l 


Variables  A (k)  and  A (k)  represent  the  areas  associated  with 

wi  w2 

subregions  w^m.njk)  and  w2(m.n;k).  respectively.  The  modified 
operator  is,  then,  defined  as 


(2.  3.6) 


D(m,  n)  = d^(m,  n)d2(m,  n).  . . d ^(m,  n)  . 


This  operator  has  been  shown  (experimentally)  to  perform 
superior  to  D(m,n),  [ll,12].  Its  implementation,  however,  requires 
selection  of  optimum  region  sizes  (value  of  l)  and  threshold  which, 
as  far  as  fully  automated  boundary  determination  techniques  are 
concerned,  makes  it  wanting. 

2.4  Spatial  Differentiation:  High  Order  Derivatives 

In  a rigorous  mathematical  setting,  the  gradient  of  a two 
dimensional  function  b(m,  n)  is  defined  as  follows.  Let  b(x,  y)  denote 


the  continuous  version 


of  the  discrete  image  function  b(m,  n).  Then, 


the  directional  derivative  of  b(x,y),  at  a point  (xQ,y0),  is  defined  as 


(2.4.D  55 


(xo'yo} 


= bx(Vy0)c°S  9 + by(X0'y0)  SinB' 


where  0 represents  a specified  direction  relative  to  the  orthogonal 
x-y  coordinate  system,  and 


(2.4.2) 


(2.4.3) 


b y > . ab(x> r> 

x(  O'V  3x 


WV  = 


3b{x.v) 


<Vy0> 


<VV 


The  gradient,  Vb(x,y),  of  the  function  b(x,  y)  is,  then,  a vector 
originating  from  point  (xq»Vq)»  pointing  in  the  direction  in  which 
b(x,  y)  has  its  maximum  directional  derivative.  Its  magnitude  is 
given  by 


(2.4.4) 


[13]. 


lVb(x0,y0)|=  /VVV+VVV 


In  terms  of  the  digital  image  function  b(m,  n),  the  partial 

derivative  functions  b (x,y)  and  b (x,  y)  can  be  approximated  by 

x y 


(2.4.5) 


(2.4.6) 


b^(x,y)  ss  b(m,n+l)  -b(m,n) 


b (x,  y)  S3  b(m+l,n)  - b(m,  n)  , 

y 


or,  alternatively, 


(2.4.7) 


b^fx,  y)  sa  b(m,  n)  - b(m+l,n+l) 


(2.4.8) 


b (x,  y)  % b(m,  n+1 ) - b(m-rl,  n)  , 

y 


depending  on  the  orientation  of  the  orthogonal  x-y  coordinate  system. 


Replacing  for  (2,4,5)  and  (2,4,6)  into  (2,4.4),  yields 


r ^ ^ 2 

(2.4.9)  |Vb(x,y)|  « ^b(m,n+l)-b(m,  n)']  + fb(m+l , n)-b(m,  n)]  . 

or,  replacing  for  (2.4.7)  and  (2.4.8)  into  (2.4.4),  we  obtain 

(2.4.10)  |vb(x,y)|  « ^b(m,  n)-b(m+ 1 , n+1  )f  + fb(m,  n+1  )-b(m+l , n)  J2  . 
Comparing  (2.4.10)  with  (2.  2.1),  one  concludes 

(2.4.11)  R(m,n)  |vb(x,y)|  . 

Thus,  as  expected,  "Roberts  cross  operator1'  is  an  approximation 
to  the  actual  gradient  of  the  continuous  image  function  b(x,  y) 

In  the  same  manner  as  above,  higher  order  derivatives  of  b(x,y) 
can  be  approximated  to  represent  spatial  differentiation  operators 
utilized  in  boundary  determination.  For  example,  the  "Laplacian 
operator,  " L(m,  n),  defined  as 

(2.4.  I9)  L(m,  n)  = |b(m,n+2)-2b(m,n  + l)42b(m,n)- 

2b(m+l , n)  + b(m+2,  n)  | , 

is  an  approximation  of 

(2.4.13)  |V2b(x,y)|  = |b  (x,  y)+b  (x,y)|  , 

xx  y y 

where  b and  b denote  the  second  partial  derivatives  of  the 
xx  yy 

continuous  image  function  b(x,y), 

uBi-Laplacian  operator,  " an  approximated  version  of 
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(2.4.14)  V4b(x,y)  = b^^fx,  Y>  + Y)byy(x*  ^ + byyyy(X’  y)  ’ 

is  another  variation  of  the  operators  employed  for  boundary  deter- 
mination. 

In  general,  an  operator  with  higher  order  derivatives  utilizes  a 
larger  region  of  the  image  to  decide  on  the  position  of  the  picture 
element  represented  by  b(m,n).  A Laplacian  operator,  for  instance, 
employs  five  picture  elements  (see  Fig.  II.  J ),  namely  b(m,  n), 
b(m,  n+1),  b(m,  n+2),  b(m+l,n),  and  b(m+2,n),  as  opposed  to  the 
gradient  operator  (equation  (2.4.9))  which  employs  three  picture 
elements  in  determining  whether  b(m,  n)  is  an  edge  point. 

Other  operators,  based  on  approximation  of  image  function  partial 
derivatives,  have  been  proposed  in  the  literature,  [lo]  . The  quality 
of  the  processed  pictures,  however,  are  about  the  same,  because 
basic  disadvantages  connected  with  spatial  differencing  techniques, 
mentioned  in  the  foregoing  sections,  are  persistantly  present 
irrespective  of  the  choice  of  the  operator. 

2.5  Contour  Following 

Contour  following  is  a heuristic  recursive  algorithm  for  boundary 
determination.  Different  contour  following  routines  have  been 
proposed  by  several  authors,  [14-18].  Sophistication  of  these  routines 
are  based  on  the  complexity  and  contents  of  the  images  under 


1 1 


consideration. 


HKf 

m,  n 

m,  n+-i 

m+1 , n 

m+1,  n+1 

m+1  ,n+2 

m +2,  n 

m+2,n+l 

mA2  ,n+2 

Figure  II.  1.  Image  Elements  Used  to  Define  Gradient  Operator  and 
Laplacian  Operator 


In  the  simplest  case,  namely  that  of  binary  images,  the  contour 
following  procedure  is  described  as  follows.  Starting  at  a pre- 
selected location,  one  scans  the  image  until  an  object  element  is 
identified.  The  scanner  is,  then,  moved  to  the  left  of  its  current 
position  to  the  next  picture  element.  If  the  new  location  is  an  object 
element,  the  scanner  is  turned  left  again.  Otherwise,  it  is  moved 
toward  the  right.  This  procedure  is  continued  until  the  scanner 
returns  to  within  one  picture  element  of  its  initial  position.  Figure 
II.  2 illustrates  the  above  operation  for  the  case  of  a two-level  image. 
The  image  consists  of  a white  diamond-shaped  object  within  a dark 
background. 

Although  contour  following  algorithms  are  simple  to  implement, 
because  of  their  serial  nature,  they  are  very  sensitive  to  positioning 
errors.  For  example,  if  a mistake  is  made  in  the  identity  of  a 
picture  element  (whether  it  belongs  to  the  background  or  object), 
total  loss  of  a portion  of  the  boundary  could  occur.  Creation  of 
sparious  edges  is  another  result  of  wrongfully  identifying  an  image 
element. 

Based  on  the  above  analysis,  contour  following  techniques  are 
restricted  to  noise  free  or,  at  best,  low  noise  images.  Special  pur- 
pose contour  following  algorithms  have  been  developed  which  sacrifice 
simplicity  for  better  performance  by  considerably  increasing  the 
amount  of  computation  time,  [14-18], 


13 


Boundary  Determination  by  Contour  Following. 
Connected  Lines  Describe  the  Object.  Arrowed 
Line  Trar  es  the  Square  Object. 


Figure  II.  2 
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2.6  Statistical  Differencing 

Let  b(m,n)  be  obtained  through  averaging  of  the  image  function 
b(m,  n)  over  a region  w in  the  image.  Furthermore,  let 


(2.6.1)  o(m,n)  = ^ [b(i,j)-b]2> 

w(m,n)  / 


Then,  method  of  "statistical  differencing,  " [l9],  utilizes  an  operator 
T(m,n),  of  the  form 


(2.6.2) 


T(m,  n)  = 


b(m,  n)  - b(m,  n) 


a(m,  n) 


To  determine  whether  the  picture  element  b(m,  n)  belongs  to  an  edge 

2 


location  or  not.  Note,  a (m,  n)  defines  the  variance  of  the  grey 
level  values,  b(m,  n),  over  the  region  w(m,  n).  The  reason  for 
explicitly  denoting  b and  a in  terms  of  m and  n is  to  emphasize  their 
dependence  on  the  selected  region  size. 

This  method  is  specially  attractive  for  detection  of  minor  edges 
in  an  image.  An  example  should  illustrate  this  feature  more  clearly. 

Let  us  select  a rectangular  region  of  grid  size  3 by  4 within  an 
image  (see  Figure  II.  3),  The  region  is  constructed  so  as  to  represent 
a minor  edge,  i.e.,  the  grey  level  value  differences  at  edge  points, 
Ab(m,  n),  are  small.  Refering  to  Figure  II.  3,  definition  of  b,  and 
equation  (2.6,1),  the  following  values  for  b and  a are  obtained. 


(2.6.3) 


b = 1.05 
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Elements 
b(m,  n)  = 1 . 1 


Region  W(3, 


Figure  II.  3, 


Background 
Elements, 
b(m,  n)  = 1 . 0 


Binary  Image  With  a Minor  Edge,  (4b  - . 1). 
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(2.6.4) 


(2.6.5) 


a = .17 


.3  in  tie  background 

3 in  the  object  . 


Replacing  values  of  b(m,  n)  with  T(m,  n).  The  minor  edge  becomes 
six  times  more  conspicuous  (&T(m,n)  = .6  as  opposed  to  Ab(m.n)  = .D. 

Method  of  statistical  differencing,  therefore,  is  suitable  for 
extracting  boundary  out  of  images  with  a lot  of  detail.  By  its  nature, 
however,  this  technique  is  restricted  to  noise  free  images. 

2.7  Replacement  Processes 

Having  covered  the  basic  past  techniques  of  boundary  determin- 
ation, the  ground  work  for  the  introduction  of  a new  technique, 
described  in  Chapter  III,  is  developed  here. 

A mathematical  model  for  the  image  function  b(m,  n)  which 
explicitly  considers  the  object  boundaries  along  with  image  internal 
details  is  proposed  as  follows.  Let 


(2.7.1) 


.N 

i=0 


Represent  a sequence  of  nonnegative,  integer,  and  binary  valued 
functions  such  that 


(2.7.2) 


N 

i=0 


= 1 


* 


Relationships  <2.7.2,  and  <2.7.3,  restrict  the  elements  of  T to  be  all 
r„  with  the  exception  of  only  one  element  (any  element)  whose 

function  is  now  represented  by 


ze 


value  must  be  1.  The  image 
,2.7.4)  b<m,n>  - £ V.<m,  n)b.<m,  n 


N 

z 

i=0 


where  the  functions  b.(m.n>,  OsitN,  denote  the  grey  level  values  of 
the  background  <i=0,  and  the  N objects  in  the  image.  The  elements  of 
the  sequence  T carry  the  boundary  information  of  the  objects  within 


the  image. 

. , uk  b are  assumed  to  be 

The  two  dimensional  functions  bQ,  bj N 

sample  functions  of  N+l  statistically  independent,  wide  sense  station- 
ary random  processes  whose  first  two  moments  are  known.  The  two 
moments,  namely  the  mean  and  autocorrelation  functions,  are  re- 
spectively indicative  of  the  brightness  and  textural  similarities  of 

b >bi bN.  Note,  an  autocorrelation  function  with  a sharp  drop 

off  from  its  maximum  corresponds  to  a finely  textured  region  of  the 
image,  [20]. 

The  binary  valued  function  V.(m,n),  another  random  process, 
takes  values  of  1 or  aero  corresponding  to  points  in  the  image 


belonging  to  the  i^  object  or  the  j^  <j*i>  object,  respectively.  In  the 


literature,  this  function  is  usually  labeled  as  the  image  "characteristic 
function."  [19].  The  statistical  properties  of  Y.  will  be  described 
later  as  the  need  arises. 
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The  image  model  (2,7.4)  is  based  on  a concept  defined  as 
"replacement  processing,  " where,  by  definition,  a segment  of  a 


function  or  random  process  i3  replaced  by  another  function  or  random 

process  according  to  certain  rule.  Considering  that  for  typical  images 

the  object  signals,  in  fact,  "replace"  a portion  of  the  background 

signal,  and/or  each  others  (as  in  the  cases  of  overlapping  objects), 

the  structure  of  this  model  is  justified.  In  model  (2,7.4),  the 

replacement  takes  place  according  to  the  values  of  y.(m,  n).  For 

i 

example,  for  a non-overlapping  3—  object,  the  replacement  of  the 
background  signal  by  the  object  signal  occurs  within  the  portion  of 
the  image  where  Y^(m,  n)  = 1. 

For  future  reference,  note  that  the  domains  of  the  sample 
functions  b^(m,  n),  , . , , b^(m,  n)  are  defined  to  be  the  entire  image. 
This,  in  fact,  is  the  main  motivation  behind  introducing  the  concept 
of  replacement  processing  in  image  modeling.  Figures  II.  4 and  11,5 
illustrate  a few  examples  of  constructing  an  image  by  replacement 
processing. 

In  practice,  the  grey  level  values  of  an  image,  b(m,  n),  here 
after  referred  to  as  "original  image,  " are  not  available  for  measure- 
ment. In  lieu  of  the  original  image,  a sequence  of  variables,  y(m,  n), 
approximating  b(m,  n)  are  a\ailable  for  observation.  This  is  due  to 
the  existance  of  disturbances  such  as  reflections  from  spurious 
objects,  inaccuracies  in  the  image  sensing  mechanism,  corruption 
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Figure  II. 4.  Construction  of  a Uniform,  Two-Level,  Single -Object 
Image.  Cross  Section  of  a Typical  Line  n is  Shown. 


m 


Figure  II.  5.  Construction  of  a Uniform,  Three-Level,  Two-Object 

(Overlapping)  Image.  Cross  Section  of  a Typical  Line  n 
is  Shown. 


introduced  during  transmission,  film  grain  noise,  and  etc.  which 
cause  distortion  of  the  original  image.  The  relationship  between 
the  original  image,  b(m,n),  and  the  observable  image,  y(m,n), 
depends  directly  on  the  sources  of  degradation.  For  instance,  dis- 
tortions due  to  film  grain  noise,  generally  introduce  a multiplicative 
noise  on  the  original  image;  i.  e.  , 

(2.7.5)  y(m,  n)  = b(m,n)v(m,  n)  , 

where  v(m,n)  is  a random  process  representing  the  degradation 
phenomena.  In  this  work,  we  will  consider  the  m.re  common  types 
of  distortions,  namely,  those  modeled  by  additive  noise.  Hence, 

(2.7.6)  y(m,  n)  = b(m,  n)  + v(m,  n)  , 

where  b(m,  n)  is  defined  in  (2.7.4),  and  v(m,n)  is  as  delineated  above. 

In  the  following  chapter,  a specific  case  of  image  modeling 
through  replacement  processing  will  be  used  to  estimate  object 
boundaries.  Prior  to  that,  however,  the  type  of  objects  considered 
in  this  work  will  be  described  in  the  next  section. 

2.8  Horizontally  Convex  Objects 

In  general,  boundary  determination  techniques  which  incorporate 
some  geometrical  properties  of  the  objects  within  the  image  into 
their  algorithm  are  superior  to  others,  flO],  Connectivity  and 
convexity  are  typical  examples  of  such  geometrical  features.  In  this 
work,  we  will  consider  images  which  contain  "horizontally  convex 


objects.  An  object  is  defined  to  be  horizontally  convex  if  the  set 

forming  that  object  can  be  characterized  as  follows. 

2 

Definition:  A set  E c IR  is  said  to  be  "horizontally  convex"  if  given 

1 /1  1 . 2 2 2 1,2  1 2 

- = (Xj,  x2)eE,  x = (Xj,  x2)cE,  with  Xj  ^ x1  and  x2  = x2> 

. 1 „ 2 

then  ax  + (l-a)x  eE,  where  0 <a<  1. 

Examples  of  such  sets  are  Ej  and  E2  in  Figures  II.  6a  and  II.  6b, 
respectively.  Set  E^  (Fig.  II.  6c)  is  not  horizontally  convex. 

Note  that  "horizontal  convexity"  is  a less  restrictive  condition 
than  "convexity."  In  other  words,  a convex  set  is  always  horizon- 
tally convex,  but  a horizontally  convex  set  is  not  necessarily  convex. 
This  fact  can  be  observed  in  Fig.  II.  6a -II.  6c. 


Figure  II.  6a.  Example  of  a Horizontally  Convex  Set. 


' — ~1 

Figure  II.  6b.  Example  of  a Horizontally  Convex  Set. 


x! 

Figure  II.  6c.  Example  of  a Set  Which  is  Not  Horizontally  Convex 


Chapter  III 

ESTIMATION  OF  OBJECT  BOUNDARY:  FORMULATION 


In  this  chapter,  we  will  develop  a boundary  estimator  for  a cer- 
tain class  of  noisy  images.  The  images  belonging  to  this  class  can  be 
partitioned  into  two  regions:  background  and  foreground.  The  fore- 
ground forms  a horizontally  convex  object.  An  object  of  interest  will 
always  be  assumed  to  exist  in  the  image.  Techniques  developed  in 
[21]  may  be  used  to  detecc  the  existence  of  the  object  in  cases  when 
its  presence  is  not  certain.  The  concept  of  replacement  processing, 
described  in  Chapter  II,  and  the  mathematical  image  model  associated 
with  it,  defined  by  relationship  (2.  7.4),  will  be  utilized  here  to 
formulate  the  boundary  estimation  problem. 

3.  1 Modeling 

A model  for  a single  object  image  whose  grey  level  values  are 
represented  by  ihe  two  dimensional  discrete  function  b(m,  n)  is 
defined  as 


(3.  1.  1) 


b(m,  n)  = y(m,n)b  (m,n)  + [1-Y(m,  n)]bb(m,n). 


This  model  is  based  on  the  replacement  processing  concept 

delineated  in  section  2.7.  The  two  dimensional  functions  b0(m,n) 

and  b (m,  n)  represent  intensity  level  values  of  the  object  and  the 
b 

background,  respectively,  and  y(m,n)  carries  the  boundary  infor.  »a- 
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tion  of  the  object  within  the  image.  Object  and  background  functions, 

b (m,  n)  and  b (m,  n),  are  assumed  to  be  sample  functions  of  two 
0 b 

statistically  independent,  wide  sense  stationary  random  processes 
whose  first  two  moments  are  given.  The  mean  values  of  b^  and  b^ 
are  indications  of  the  object  and  background  brightness  similarities, 
whereas,  their  respective  autocorrelation  functions  are  measures  of 
the  object  and  background  textural  information.  The  binary  valued 
function  y(m,  n),  another  random  process,  takes  values  of  1 or  0 
corresponding  to  the  points  in  the  image  belonging  to  the  object  or 
the  background  respectively.  The  statistical  properties  of  y will  be 
described  shortly.  Note,  the  characteristic  functions  y(m,  n)  and 
fl-y(m,n)]  satisfy  relationships  (2.  7.  2)  and  (2.  7.  3).  Furthermore, 
note  that  (3.1.1)  is  compatible  with  the  image  model  (2.7.4)  for 
N = 1.  Hence,  (3.  1.1)  is  a replacement  processing  model  for  the 
image  signal  b(m,  n),  and,  as  a result,  the  domain  of  the  sample 
functions  b^(m,n)  and  b^(m,n)  are  the  entire  image. 

A sequence  of  observations  constructed  as 

(3.1.2)  y(m,n)  = b(m,n)+v(m,n) 

are  assumed  available  for  measurement,  where  b(m,  n)  is  as 
defined  in  (3.  1.1),  andv(m.n)  denotes  an  uncorrelated  process 
representing  the  observation  noise. 
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3.2  Scanning 

An  image  scanner  is  now  employed  to  transform  the  planar  data 
representing  the  noisy  image.  y(m,n),  into  temporal  data.  y(k).  The 
scanner  output,  in  the  absence  of  observation  noise,  is  denoted  by 
s(k),  where 

(3  2.1)  s (k)  = X(k)Sg(k)  + [l -Mk)]  s^(k) 

models  the  image  in  terms  of  its  grey  level  values  and  object  bound- 
ary as  viewed  by  the  output  of  a line  by  line  scanner. 

The  structure  of  the  one  dimensional  model.  (3.2.1)  preserves  the 
replacement  processing  concept.  The  functions  sQ(k)  and  s^k)  are 
associated  with  bQ(m,n)  and  b^m,  n).  respectively.  In  other  words, 

s (k)  and  s (k)  denote  the  intensity  values  of  the  scanned  object  and 

0 b 

background,  and  are  assumed  to  be  sample  functions  of  two  statisti - 
cally  independent,  cyclo-stationary  random  processes,  [5,  22],  whose 
first  two  moments  are  obtainable  directly  in  terms  of  the  fiist  and 

second  order  statistics  of  bQ(m,  n)  and  bb(m,n),  [23].  As  in  the  case 

of  b and  b , the  domain  of  the  sample  functions  sQ(k)  and  s^k)  are 
0 b 

the  entire  scanned  image. 

The  binary  valued  function  X(k)  is  the  one  dimensional  counter- 
part of  Y(m,  n).  Its  statistics  are  described  in  section  3.  3.  Note  that 

the  statistics  of  X(k)  completely  define  those  of  Y(m,n). 

The  two  dimensional  observation  sequence  y(m,n)  in  (3.  1.2)  will 
also  be  replaced  by  its  scanned  version  defined  as 
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. b**  * 


(3.2.2) 


y(k)  = s(k)  + v(k)  , 


where  s(k)  is  as  defined  in  (3.2.  1),  and  v(k)  is  a zero  mean  Gaussian 

2 

white  noise  process  with  variance  a . 

3.  3 Representation  of  X(k) 

Let  m1  and  denote  the  first  and  the  last  lines  of  the  object  as 

viewed  by  the  scanner.  Furthermore,  let  a and  (3  represent  the 

beginning  and  end  points  of  the  object  on  line  Z,  respectively.  In 

general,  rr^.rr^.a^,  and  8 , for  rrij  £Z  £m2,  are  random. 

The  function  X(k),  appearing  in  (3.2.1),  is  now  defined  in  terms  of 

m.  , in  , a.  and  8 ao 
1 2 £ £ 


m. 


(3.3.1)  X(k)  = «[k-a^-(i!  -1)J]  - u[k-^- U-  l)j] 


l =m 


1 


where  u[«  J is  the  unit  step  function,  J denotes  the  number  of  picture 
elements  in  one  line  of  the  image,  and  B 2a  . The  statistics  of  the 
process  X(k)  can  now  be  given  in  terms  of  the  statistics  of  rr^ , , 

and 


(3.  3.2) 


w*  = <W 


l 

V 


* 


Let  us  assume  w^  to  form  a first  order  Markov  process.  This 

assumption  is  made  for  the  sake  of  computational  simplicity,  and  it 

emphasizes  the  dependence  of  the  object  boundary  points  on  line  l 

upon  the  boundary  points  located  on  the  previous  line,  i~\ . It  is 

further  assumed  that  the  density  functions  p(a  la  8 m) 
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p(Sj!|VVrB*-rmi)'  p(m2l  rrij),  and  p(m^)  are  given,  and  that 

(3.3.3)  p(wi  lw/_rml'r*V  “ p(wJWi -1*  "V  * 

For  future  reference,  notice 


(3.3.4)  P<wi  = p(VPilVl»Pi-l'ml) 

(3.3.5)  Pl«r®iIVrPM'”ll  = p|ai|oi-]’fM'ml1' 

p(Pj  '■ 


therefore, 


(3.3.6)  p(w^  l«'x.1.nll)  = p(a/|ai_1,Pi_1,m1)p(^|ai,aj_1,^_1,ml). 


3.4  Problem  Statement 

Relationships  (3. 2.  1 ),  (3.2.2),  and  (3.  3.  1 ) along  with  the  defini - 
tions  and  assumptions  given  in  the  previous  section  3.3,  constitute  the 
basis  for  the  boundary  estimation  problem  of  this  chapter.  The 
objective  here  is  to  locate  the  object  boundary.  For  this  purpose, 
estimates  of  the  first  and  last  lines  (m^  and  m^),  and  estimates  of  the 
starting  and  ending  points  (a  and  S ) of  the  object  are  sought.  Looked 

JC  jL 

upon  as  an  estimation  problem,  the  problem  statement  is  summarized 
as  follows.  Define 


(3.4.  1) 
(3.4.  2) 


s(k)  = X(k)S()(k)  + [1-X(k)>b(k) 


y(k)  = s (k)  + v(k) 


m_ 


(3.4.3)  X(k)  = ^2  u[k-ai-(i-l)J]  + u[k-P£-(£-l)j'l  , 


i - mi 
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where, 


i)  Es  (k),  Es0(k1)s0(k2),  Esb(k),  and  Es^kj  )sb(k2)  are  given; 

ii)  w = (a  , S3  ) represents  a first  order  Markov  sequence  for 

rrij  Sm2* 

lii)  P ia.  form  ^ m ; 

£ £ 1 £ 

and  iv)  P(0£  la£.1»Pi.1*m1)»P(Pilai'a/_1.P/_1.m1),p(m2|m1), 
and  p(m1)  are  known. 

Then  we  wish  to  obtain  a set  of  estimates  for  in2>  a^,  and  (3^, 

m £m_,  based  on  the  available  observation  sequence,  y(k), 

1 c* 

1 ^k  ^N.  The  fixed  integer  N denotes  the  total  number  of  picture 

elements  in  the  image. 

3.5  Grey  Level  Value  Estimates 

The  boundary  estimation  procedure  developed  in  this  chapter,  as 

it  will  b shown,  requires  the  values  of  s fk)  and  s (k),  1 sk  5N. 

0 b 

Since,  in  general,  these  values  are  not  known  (cases  of  known  images 

are  exceptional),  a set  of  estimates  of  s^Ck)  and  s^(^)»  often  minimum 

mean  square  estimates,  will  be  used  in  their  place.  Based  on  the 

ei'  en  mean  and  autocorrelation  functions  of  s fk)  and  s (k),  a set  of 
° Ob 

minimum  mean  square  estimates  of  s (k)  and  s (k)  can  be  obtained  by 

0 b 

implementation  of  the  results  in  [23*1.  Note  that  the  concept  of 

replacement  processing  assures  the  existance  of  the  estimates  of 

s (k)  and  s,  (k)  for  all  k in  the  range  of  [l,N].  Since  the  aim  of 
0 b 

this  dissertation  is  estimation  of  object  boundary,  throughout  this 

30 


r 


I 


I f 
* 


I* 

I Y.w. 

? 


m 


chapter,  we  will  assume  the  values  of  Sg(k)  an^  s (k),  or  their 
corresponding  minimum  mean  square  estimates,  are  given. 

3.6  Boundary  Points  Estimates 

The  boundary  estimation  problem,  as  is  evident  from  (3,4,1)  and 

(3.4.2),  is  a nonlinear  estimation  problem.  Moreover,  due  to  the 

type  of  nonlinearities  involves  (such  as  the  binary  nature  of  X(k)),  the 

available  estimators  based  on  linearization  concepts  (such  as  extended 

Kalman-Bucy  filters)  do  not  yield  satisfactory  results.  In  the  sequel, 

a set  of  maximum  a-posteriori  (MAP)  estimates  for  the  unknowns 

m,,  rn  , a.,  and  B , m,  £1  sm_,  are  obtained. 

1 2 l /I  2 

Consider  an  image  of  grid  size  M by  J,  resulting  in  a total  of  N 
pixels  (picture  elements).  The  fixed  integers  M and  J denote  the 
number  of  lines  in  the  image  and  the  total  number  of  pixels  in  each 
line  of  the  image,  respectively.  Let  us  define 


(3.6.1) 


= (m1,m2) 


(3.6.2) 


W = (w  , w , ... , w ) 
— m +1 


where  w , m,  £ l £m_,  is  defined  in  (3.3.2),  The  objective  in  this 
Z 1 2 

section  is  to  derive  the  MAP  estimates  of  and  W. 

Consider  relationship  (3.4.2)  as  the  observation  model.  Define 
the  M-di' nensional  vectors  S,  Y,  and  V as 


(3.6.3) 


sa.w)  = [Jyjz 


r 
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A 


(*.6.4) 


(3.6.5) 


Y = [Vy2 V 


V = [v,,v2, 


V 


where  "prime"  denotes  transposition,  and 


+ 1 ],  s^[(-^_  * )J  +2],.  . . , s [i  j"l"|  for 


Is  ,i< 


<(  s M 


Jl  = K^-1)J +1 1 sb[(/-l  )J*y  l ],  Sf)[U-l  Jj+Ogl, .... 

(3.  6.  6)  s0[(i-l)J+3j,  sb[(^-l)J+p^+l]  , . . . , 8 &jTT  for 

(3.6.7)  Y^  = B^U-MJ+n.y[(^-l)J+2],...,y[j(  J]]',  1 

(3.6.8)  = [vfo -l)J+l],  v[(4-l)J+2],  . . . , v[(  j]]\  1 fiisM 
are  each  a vector  of  dimension  J.  Then,  from  (3.4.2), 


(3.6.9) 


Y = S(^  , W)  + V 


where  Y is  the  observation  vector.  The  observation  noise,  V,  is 
assumed  a Gaussian  process  with  mean  zero  and  covariance  a I, 

"I"  denoting  the  identity  matrix. 

The  form  of  the  vector  S(^_,W),  defined  by  (3.6.3)  and  (3.6.6)  is 
a consequence  of  having  one  object  of  interest.  The  reason  for 


explicitly  denoting  S in  terms  of  fT[  and  W is  to  underscore  the 


vari- 


ables we  are  specifically  concerned  with.  Note  that  the  vector  S is 
random  due  to  the  randomness  of  and  W,  or  equivalently  m^,  m^, 
cy  and  B/,  rr^  <-l  Sm2. 

To  proceed  with  the  MAP  estimation  of  and  W,  certain  a-priori 
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statistics  are  required.  The  given  density  functions  p-'m  ),p(m  |m  ), 

i b 1 

P^g  1 ’ 1 * ml  an<^  I i » j » ^ ) will  be  shown  to 

suffice. 

It  is  well  known  that  MAP  estimates  of  and  Ware  such  values 
of  and  W that  maximize  the  joint  probability  density  function 
P(Y where  Y,  and  W are  as  defined  in  (3. 6.  9),  (3.6.1),  and 
(3.6.2),  respectively,  [24*].  From  (3.6.9),  where  V was  assumed 
Gaussian  with  mean  zero  and  variance  o , and  based  on  the  fact  that 

(3.6.10)  p(Y , %,  W)  = p(Y  |ft,  W)p(W|fr)p(^) 
we  have 

(3.6.11)  p(Y,^,W)  = (2  no2)  2 exp  < - — -r-  [Y-S(W?,  W)] '• 

* 2o 

[Y-S®  W)]  + In  p(W  \7n)  + In  pffi)  j . 

Taking  natural  logarithm  of  both  sides  of  (3.6.11)  yields 

(3.6.  12)  In  p(Y,^,  W)  = - [Y-S(^,  W)]'[y-S(^,  W)]' 

2o  ~ 

[Y-S(^,  W)]+  In  p(W|ft)  + In  pffl)  . 

Taking  natural  logarithm  of  both  sides  of  (3.6.11)  yields 

(3.6.12)  In  p(Y,%,  W)  = - fy-S^,  W)] '[Y-S^,  W)1 

2o 

+ In  p(W  |tf?)  + In  p0  - ^ In  2tTo2  . 

Note  that  since  logarithm  is  a monotonic  function,  those  values 
of  W and  W which  maximize  p(Y,^,  W)  coincide  with  the  mode  of 


In  p(Y ,ft?,  W).  Considering  the  foregoing  comment  and  the  fact  that 
the  last  term  on  the  right  side  of  (3.6.12)  is  a constant,  maximizing 


In  p(Y,ft(,  W_)  is,  then,  equivalent  to 

(3.6.13)  max  j - -y  [Y-S(ftJ,  W)VLY-S(^,  W)"|  + In  p(W \Wl  +lnp(W)J  . 

ft?,W  ( 2a  * 

Furthermore,  expanding  the  expression  inside  braces  in  (3.6.13), 

and  considering  that  the  term  Y'Y  is  invariant  under  maximization  of 

ft!  and  W,  (3.  6.  1 3)  is  equivalent  to 

(3.6.14)  max)-  -y  S'  (ft?,  W)[S(ft; , W)-2y]  + In  p(W  |ft!)  + In  p(fti)  > . 

fti,w(  2°  * 

or, 

2 2 

(3.6.15)  min  [S'(ft[,  W)[S(ft[,  W)-2Y]  - 2a  In  p(W  |ft!)  - 2a  In  p©)  . 
ft[,  W 

Before  proceeding  with  the  minimization  process  in  (3.6.15),  let 
us  transform  it  from  vector  into  scalar  notation.  From  (3.6.3)  and 
(3.  6.  6),  we  obtain 


M 


(3.6.16)  S'(£,W)S(0|,W)  = 

i=l 


rrij  - 1 l J 

E E 


m. 


s,  (k ) + 


l- 1 k=(je  -1  )J  + 1 /=m. 


(i-  1 ) J+Og-  1 


sf  (k)  + 

b 


£ vk,+ 

k=(i-l  )J+a 


l 


iJ  7 

_ vkl 

k=(i-l)J+B +1 

Xj 


E 

k=W  -1)J+1 
M l J 

£ E 

^=m2  + l k=(i-l)J+l 


s,  (k) 
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Similarly, 

from  (3.  6.  3),  (3.  6.  4), 

(3.6,6),  and  (3.6.7),  we 

obtain 

M 

(3.6.  17) 

S'p,W)Y  = 

1=1 

mr1  ij 

m2 

(l- 1 )J+a  - 1 
l 

E E s»,k,y(k|  + E 

\ 

4 

E 

sfe(k)y(k)  + 

i=l  k=(i-  1)J+1 

i=m^  | 

k=(i 

|T)J+1 

(i-i)J+^ 

-e  j 

1 

sQ(k)y(k)  + 

V sb;k)y(k) 

+ 

k=(i-l)J+Og 

k=(/-l)J+B+l 

l 

M l J 

^ E sb(k)y(k)  • 

/=m2+l  k=(/-l)J+l 


Combining  (3.  6.  16)  and  (3.  6. 17)  results  in 


(3.6.18)  S'(tt?,  W)[Sffi,  W)-2Yl  = 


mr1  u m2 

E E ’vk)  + E 

1=1  k = (^-l)J+l  £ =mi 

6e-i)j+p,  u 

E 

k=(/-l  )J+a 


(^-l)J+a„  -1 
l 

E 

k=(i- 1 ) J+l 


Kb(k)  + 


Ko(k)  + E Kb,k) 

k=(£-l)J+P^+l 


M l J 


E E vk>’ 

^=m2  + l k=(X- 1 ) J+l 


where 

(3.6.  19) 

Vk)  - 

sb(k)[sb(k)-2y(k)]  , 

and 

(3.6.20) 

Ko,k)  = 

s0(k)[sn(k)-2y(k)] 
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Note  that  K^k)  and  KQ(k)  are  defined  for  all  1 £k  *N. 

To  put  (3.  6.  1 8)  in  a more  compact  form,  let  us  add  to  and  sub- 
tract from  the  right  side  of  (3.6.18)  the  quantity 

JU 


m_ 

? £ 

k=(/-i) 


Kjk). 


k=(-e-i)J+i 

Then  (3.  6.  18)  can  be  written  as 

M i J 

(3.6.21)  S'®,W)[S®,W)-2Y]  = ^ Vk)  + 

i= 1 k=(£-l  )J+1 

m~  (£-l)J+fJ. 

E £ [K0(k).Kb(k)i . 

is  1 k=(i-l)JKl£ 

Since  the  first  term  on  the  right  hand  side  of  (3.6.1),  i.e. 


M i J 


N 


£ £ Kb,k)  = E vk> 

fel  ks(i-l)J+l 


k=l 

is  a constant  with  respect  toff!  and  W,  it  will  be  omitted  out  of 
minimization  process  (3.6.15).  Replacing  what  is  left  of  (3. 6.  21) 

into  (3.  6.  15),  we  obtain 

2 ...  . 2 


(3.6.22)  min 

771 , W 


-2cr  In  p(7fl)  - 2a  In  p(W_|^)  + 


m. 


(i-l)J+P, 


£ E K<k»-Kb(k,i 


l k-(X-l)J+a^ 


Defining 
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(3.6.23) 


K(k)  = KQ(k)  - iyk) 


(3.6.24) 


(-e-MJ+P, 


T^)  £ ^ K(k)  , 


k=(^  - 1 ) J+OL 


(3.  6.  22)  can  be  written  as 


(3.6.25)  min  -2a2  In  p(tf?)  - 202  In  p(W|ft)  + V T(w 


) • 


Furthermore,  from  (3.3.3),  (3.6.2),  and  the  assumption  that  is 


first  order  Markov, 


(3.6.26)  p(W|^)=p(w  |wm  4,m1)p(wm  ^n^)... 


m2  m2"  m2"  2' 


. . . p(w^^ | , mi ’plWm^  1 mi  > • 


where 


(3.  6.27) 


p(w  | w m ) = p(w  |m  ) . 

r mj  1 mj  -1  1 mj  1 


From  (3.  6.  26),  then, 


(3.6.28)  lnp(W|tfi)  = ^ In  p(wj w^  _ j ) . 


l =m. 


Replacing  for  (3.6.28)  and 


(3.6.29)  In  p(fl?)  = lnp(m1,m2)  = In  p(m2  jm^  + In  p(mj) 


into  (3.  6.  25),  yields 


(3.6.30)  min 

%,  w 


2 . 2 

-2(7  In  p(m2|m1)  - 2rr  In  p(mj)  + 


m„ 


z 

y]  fT(w^)  - In  In  p(wi|w^_1,m1)1 


l =m 


1 


To  obtain  MAP  estimates  of  m^  m2>  0.^,  and  3^.  m}  Sm2* 
the  minimization  in  (3.6.30)  must  be  performed.  Techniques  of 
finding  the  extremums  of  (3.  6.  30)  through  differentiation  do  not  apply 

here  since  the  variables  m^,  0.^  , and  3^*  mi  Srn2’  are  nr 

continuous.  Alternative  methods,  however,  are  possible  and  will  be 

the  subject  of  the  next  chapter. 
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Chapter  IV 


ESTIMATION  OF  OBJECT  BOUNDARY: 

PROPOSED  SOLUTION 

Acquisition  of  a numerical  solution  for  the  minimization  process 
(3.6.30)  is  an  integral  part  of  this  dissertation.  Since  a rigorous 
solution  of  (3.6.30),  resulting  in  a set  of  optimal  estimates  for  m^, 
m , a , and  8,  m £1  s rn  , is  computationally  unacceptable, 

L*  JL  £ 1 Lt 

approximate  solutions  are  sought.  Two  possible  approaches,  shown 

later  to  yield  satisfactory  results  are  proposed  below. 

One  approach  is  to  obtain  the  estimates  of  a,  and  B , over  the 

11 

range  m^  Sm^,  with  the  assumption  that  values  of  m^  and  are 
given.  For  example,  values  of  m^  and  may  be  chosen  as  m^  = 1 
and  m^  = M,  implying  the  object  boundary  points  lie  on  every  line  of 
the  image.  Then,  if  necessary,  one  may  utilize  additional  structural 
properties  of  the  object  to  eliminate  those  boundary  points  estimates 
which  are  incompatible  with  the  given  structural  information.  Ex- 
amples of  structural  properties  include  shape  and/or  size  of  the 
object  within  the  image. 

An  alternative  approach  is  to  consider  the  problem  in  two  steps; 

namely,  first  solve  for  the  estimates  of  a and  (3  , m.  £ l <m_, 

£ £ A £• 

A A 

denoted  by  a,  and  8 , for  a selected  set  of  m,  and  m_  , Then,  solve 
l l 12 

A A A a 

for  the  estimates  of  m.  and  m (m.  and  m_)  by  replacing  a and  B 

1 LI  m Xj  Xj 
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for  a and  (3  . A recursive  procedure  will  result  if  the  above  two 

a i 

steps  arc  performed  at  each  scan  line  producing  an  algorithm  which 
yields  a set  of  estimates  for  m^,  m^,  > anc^  concurrently. 

The  former  approach,  as  compared  with  the  latter,  is  computa- 
tionally more  attractive.  However,  it  requires  additional  information 
of  a deterministic  geometric  nature  on  the  object  beyond  those  given 
statistical  information  delineated  in  section  3.4. 

We  will  elaborate  on  both  approaches  below. 

A A 

4.  1 Derivation  of  a.  and  Given  m.  and  m 

• J l 1 £ 

In  the  case  when  rr^  and  m 2 are  a-priori  given,  (3.6.30)  can  be 
reduced  to 

m_ 


(4.1.1) 


min 

W 


2 

l =m 


Y]  [Tfw^^a  In  p(W/ |w/_1.m1)] 


1 


Expanding  p(w^  1 l’ml^  aS  *n  ( ^ • 3 . 5) , (4.1.1)  is  written  as 


(4.  1.2)  min 
W 


m. 


2 

y [T(w^)-2o  In  ^ r - 


l =m 


1 


2 

2a  In  P(P£  la/*aje.1.P/.1*m1) 


Furthermore,  from  (3.6.24), 

(£-l)J+B.  (£-l)J+a  -1 

M - I JC  ■ ** 

(4.1.3)  T(w^)  = Yj  K(k)  ' L-J  K(k)  * 

k=(*-l)J+l  k=(i-l)J+l 

Replacing  for  F(w  ) into  (4.  1.2)  yields 

Aj 
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(4. 1.4) 


min 

W 


m2 

E 

2o2  In  p(a^  | 

ai  -rBz  -rmi’  • 

l =mj 

2o  In  p(Bg 

^4,a/-rp/-i’mi’ + 

(i 

{2  -1  )J+a  -1 

E K(k) 

• E K(k) 

k=(>e  -i)j+i 

k=(i-i):+i 

A recursive,  easily  implementable  solution  of  (4.1.4)  is  possible 
if  the  density  functions  p(c^  1°^  . l ’ 1 ’ ml  ^ and  -l’^-l'”1^ 

A . A A A 

are  approximated  by  p(a^  |a^  . i » ^ . 1 * ml  ^ and  *a^  ’ - 1'  - 1 ' ml  ’ 

respectively.  Hence,  the  minimization  process  (4.1.4)  is  replaced 


by 


(4.1.5)  min 


m 


W i „ 

— ' i =m 


^ [ -20 2 In  P^IV^.r1^)  - 


2a2  In  p(p  IVVi»Pi.l*ml)  + 


(i!-l)J+R 


[l  -l)J-Kyl 


y;  K(k)  - ^ K(k) 

k=(£- 1 )J  + 1 k=(£-l)J+l 


To  express  (4.  1. 5)  in  a compact  form,  let  us  define 


(*-)  )J4a  -1 


(4.1.6)  g(o ,)  = -2r2  lnp(a , I V r f**.  1 • ml>  ‘ 2-1  K,k’  ’ 


k=^-l)J+l 


and 


(4.1.7)  h(P^)  = -2 a In  p(P^  !ae,a£_1,  + 


(J-1)J+?. 


E K,h) 


k=(i  - 1 ) j+i 
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1 


for  rrij  Sm2’  Then  (4.  1.  5)  can  be  written  as 


(4.  1. 8) 


U 

in  ^ [g(a^)  + h(g^  )1  . 


w , 

— ' 4=m 


Note  that,  from  (3 . 6.  27) , for  l - m. 


(4.  1.9) 


(4.  1.  10) 


c I 

g(a  ) = -2a  In  p(a  m ) - 

1 


(m.  - 1 ) J+a  - 1 

1 m. 


mi 

£ 


k = (nrij  - 1 ) J+l 

(m  -1)J+P 

J m , 


h(P  ) = - 2a  In  p(P  |a  , m ) f 1 K<k)  . 

m j 1 / i 


k=(m^  - 1 )J+1 


The  minimization  process  (4.  1. 8)  can  now  be  simplified  consider- 
ably, because  a typical  term  of  the  summation  in  (4.  1.8),  for  example 

A = m,  is  a function  of  the  variables  a and  (3  only.  Consequently, 

mm7 

(4.1.8)  is  equivalent  to 


(4.1.11) 


U 

y j min  h(pg  ) + min  g(a^) 
CL, 


This  minimization  is  performed  recursively  as  follows. 


Step  1.  Determine  a by  minimizing  g(a  ).  This  is 

m j 

possible  since,  from  (4.  1.9),  g(&  ) is  a function  of 

ml 

a only. 
ml 

A 

Step  2.  Determine  3^  , based  on  the  result  of  step  2,  by 

minimizing  h(P  ).  This  again  is  possible  since, 
mi 

from  (4.  1.  10),  h(3  ) is  a function  of  the  variables 

ml 


8 and  a only. 

rrij  rrij 

Step  3.  Set  l = fl. 

A A A 

Step  4.  Determine  a , given  a and  8 from  previous  steps, 

X X — i.  4"  1 

by  minimizing  g(a.  ). 

x 

A A A A 

Step  5.  Determine  8 , given  a , a .,  and  8.  , , by  minimizing 

X X " A -v  ” A 

h(fv- 

Step  6.  Set  l - l + 1 . 

Step  7.  Check  to  determine  if  l >m2*  ^ "Yes",  go  to  step  9. 

If  "No",  proceed  to  the  next  step. 

Step  8.  Go  to  step  4. 

Step  9.  Terminate  the  computations. 

A 

Notice,  based  on  the  definition  of  \(k)  in  (3.4.3),  8.  i8  constrained  to 

X 

A 

be  2 a. . 

I 

The  computational  procedure,  as  described  above,  is  clearly  a 

I A 

recursive  one.  Specific  choices  of  the  density  functions  p(a  |a 

/ Xi  “ i 

A * A A A 

8^  , , m^  ) and  p(8^  |a^,  a.^  ^ , 8^  ^ , m^ ) are  required  to  implement  this 
algorithm.  This  will  be,  however,  postponed  to  a later  section. 

Use  of  add;tional  structural  knowledge  about  the  object  (such  as 
its  shape)  will  then  complete  this  approach  by  locating  the  actual 
positions  of  the  first  and  last  lines  of  the  object. 

A A 

4.  2 Derivation  of  m^  and  m^ 


We  will  now  elaborate  on  the  second  approach  referred  to  before. 

A A 

The  first  step  of  the  problem,  namely  that  of  obtaining  a and  8.,  was 
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4 


f , *■  A »**''' 


»* 

h 


a olved  in  section  4.1.  Replacing  the  estimates  and  ^ for  0.£  and 

p in  (3.6.30),  reduces  the  minimization  process  (3.  6.  30)  to 

2 


m„ 


(4.2.1)  min 

% 


-2o2  In  p(m2|m1)  - 2a  In  ^ 


T(w„)  . 


X=m, 


where  i(  = , B*  ),  and  Tl^t  is  as  defined  in  (3.6.24)  with  ^ and  fj. 


replaced  by  0^  and  ^ , respectively.  Let  us  define 


(4.2.2) 


then, 


m 


A(m)  = ^ T(w^)  ; 

1=1 


m„ 


(4.2.3) 


A(m2)  - Mmj'  = ^ T(w^)* 


1= m. 


Replacing  for  (4.2.3)  into  (4.2.1),  we  obtain 

(4.2.4)  min  {-2a2  In  p(m2|m1)  - 2a  In  pfrr^ ) + A(m2)  - A(m1  1)}. 

7n_ 

Considering  that  Th  = (m, , m2).  (4.2.4)  can  be  rearranged  as  follows. 
(4.2.5)  min  {-2a2  In  p(mj)  - AO^-l)  + min  [-202  In  p(m2  jnij)  + A(r^)]l. 


m. 


Furthermore,  let  ^ be  uniformly  distributed  over  the  discrete 
interval  fl,M"];  i.e., 


(4.2.6) 


and  let  m. 


(4.2.7) 


P(ml>  = m ’ 

be  uniformly  distributed  over  [rr^.M]  ; i.e., 


p(m2|m1)  = 


1 


M-mj 
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Then,  (4.  2.  5)  can  be  written  as 


(4.2.8)  min  (2a2  In  M - Afnij-l)  + min  [ 2a  lnfM-m^i  A(m2)l]  . 

ml  m2 

Crossing  out  the  constant  terms  and  rearranging  (4.2.8),  yields 

(4.2.9)  min  {2 a In  (M-m^  - Afri^-l)  + min  DUn^)]}  . 

ml  m2 

It  is  clear  that  the  minimization  process  (4.2.9),  with  respect 

to  m and  m_,  is  separable.  That  is,  it  can  be  considered  as  two 
1 2 

independent  extremization  processes,  namely, 

2 

(4.2.10)  max  [Afir^-l)  - 2 a ln(M-mj)],  1 £M  , 


m. 


and 


(4.2.11)  min[A(m2)],  m^m^M, 


m, 


where  satisfying  (4.  2.  10)  yields  m ^ and  (4.  2.11)  yields  m^ . In  other 
words,  defining 

A 2 

(4.2.12)  C(m)  = A(m-l)  - 2a  In  (M-m)  , 

Estimates  of  m^  and  m2  are  obtained  by  locating  the  relative  maxi- 
mum and  minimum  of  C(m),  1 ^m  ^ M,  and  A(m),  ^m  ^M, 
respectively. 

To  acquire  further  insight,  variations  of  A(m)  and  C(m)  with 
respect  to  m are  obtained  graphically  by  considering  relationship 


(4.2.2).  Noticing  that  \(m)  is  obtained  through  discrete  integration 
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A 

(summation)  of  T(w  ),  we  will  examine  this  function,  i.e.,  r(w^  ), 


closely.  From  (3.  6.  24), 


(i-l)J+P, 


(4.2.13) 


T(^)  = y K(k)  * 


k=(£- 1 )J+a 


or,  from  (3.6.19),  (3,6.20),  and  (3.6.23), 

(i-MJ+Bj 

(4.2.14)  T(w^)  = 'YJ  s0(k)[s0(k)-2y(k)l  - sb(k)rsb(k)-2y(k)^  . 

k=(/-l ) J+a^ 

Rearranging  the  terms  in  (3.9.  14),  we  obtain 

tf-MJ+Sj 

(4.2.15)  T(w  ) = fs0(k)-y(k)]2  - [sb(k)-y(k)]  . 

k=W  - l)J4a, 

Behavior  of  A in  two  regions  of  the  image,  namely,  background  and 
object,  are  of  interest  to  us.  First,  let  us  consider  the  region  of  the 
image  corresponding  to  background,  A portion  of  this  region  corres- 
ponds to  where  1 ^Smj  and  m 2 <1  ^ M,  with 


(4.2.16) 


y(k)  = s (k)  f v(k)  . 


Replacing  for  (4.  2.  1 6)  into  (4.2.15),  yields 

(Je-i)J+l/ 

(4.2.17)  T(w^)  = Y,  [sQ(k)-sb(k)]2  - 2v(k)[s0(k)-sb(k)1  . 

k=(^-l)Jta4 

For  the  sake  of  simplicity,  let  us  assume  sQ(k)  = SQ  and  sb<k)  = sb 
are  constant  (case  of  binary  images);  then,  relationship  (4.2.  17) 


reduces  to 
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s. 


I 

t 

'k 

tl 


Ji 


(i-l)J+B 


- - 2 


(4.2.18)  VIHVV  ^VV  S 


v(k)  . 


k=(<0- 1 ) J+a 


l 

Considering  that  the  random  process  v(k)  is  zero  mean,  the  summa- 
tion term  in  (4.2.18)  can  be  approximated  by  zero.  Therefore, 


(4.2.19) 


T,V  ~<ViC1|,8o-ab’2 


for  1 <mi  and  m>  £ M.  Since  we  restricted  8 to  be  always 

A A 

^ a. » T(w  ),  as  represented  in  (4.2.19),  is  always  a positive  quantity. 
Note  the  relationship  (4.  2,  19)  would  be  an  exact  one  in  cases  of  noise 
free  binary  images. 

Now,  let  us  consider  the  region  of  the  image  correponding  to  the 
object.  A portion  of  this  region  is  related  to  where  m,  £•£  ^m^  with 


(4.2.20) 


y(k)  = sQ(k)  + v(k)  . 


Similar  computations  as  for  the  background  region  results  in 


(4.2.21) 


T'V  “ V'X'o-V2 


for  rrij  Sm2*  Relationship  (4.2.21)  is  clearly  an  indication  of 
T(w  ) being  always  a negative  quantity  in  the  object  region  of  the 
image. 

From  relationships  (4.2.19),  (4.2.21),  and  the  definition  of  A(m) 
in  (4.2.2),  we  conclude  Figures  IV.  1 and  IV.  2 represent  typical 
graphs  of  A(m). 
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It  is  noteworthy  to  mention  that  in  cases  of  working  with  highly 
degraded  images,  corresponding  to  signal-to-noise  ratios  of  less  than 
unity,  variations  of  the  form  shown  in  Figure  IV.  3 have  been  observed 
for  A(m).  Intuitively,  this  is  due  to  highly  unpredictable  oscillatory 
values  introduced  by  the  noise  term,  v(k),  in  (4.2.  18)  as  a result  of 
working  with  low  signal-to-noise  ratio  images.  The  adverse  effect  of 
this  problem  can  be  significantly  alleviated  through  inspection  of 

A A 

Figures  IV.  1-IV.  3.  Notice,  the  locations  of  rrij  and  in  all  cases 

(high  or  low  signal-to-noise  ratios),  coincide  with  two  significant 
slope  changes  in  the  graphs  of  A (m).  Therefore,  when  designing  an 
algorithm  to  determine  those  values  of  m which  satisfy  criteria 
(4.2.10)  and  (4.2.11),  we  shall  exploit  this  significant-slope-change 
feature  delineated  above.  Since,  as  it  is  evident  in  Figures  IV.  1- 
IV.  3,  the  significant-slope-change  feature  holds  for  noise  free  and 
low  noise  images  as  well  as  high  noise  images,  the  resulting  algorithm 
should  be  applicable  in  all  cases. 

The  above  artificial  manipulation,  undertaken  to  improve  the 
estimates  of  and  m^,,  is  analogous  to  when  the  optimum  Kalman 
gain  of  a Kalman-Bucy  estimator  is  varied  to  improve  the  resulting 
estimates.  An  explicit  example  of  such  a situation  can  be  found  in 

[25]. 

An  algorithm  has  been  developed  to  determine  those  values  of  m 
which  maximize  C(m)  and  minimize  A(m)  by  searching  for  the 
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Figure  III.  1.  Noise-Free  Image. 


A(m) 

I 

! 


Figure  III.  2.  Noise  Image. 
A(m^ 


Figure  III.  3.  High-Noise  Image 


significant  slope  changes  in  C(m)  and  ^(m),  respectively.  Such 
values  of  m are  accepted  as  the  estimates  of  first  and  last  lines  of 
the  object.  Details  of  this  algorithm  are  best  shown  concisely  by  the 
flow  chart  in  Figure  IV.  4.  The  procedure  is  recursive  and  easily 
implementable  on  a digital  computer.  Notice  that  estimates  of  and 
m are  computed  concurrently  with  those  of  a and  B in  a line  by  line 

£ Xj  X/ 

manner.  Examples  in  section  4.4  should  illustrate  the  results  of  this 
section  to  our  satisfaction. 

4.  3 Choice  of  Density  Functions  for  a and  8 
_ l l 

To  implement  the  results  of  section  4.1,  specifically  to  carry 

out  the  minimization  process  of  (4.  1.11),  knowledge  of  the  density 

x 1 ’ i*  ml^  and  P^« > l'Vag  \ ' ml ) are  required. 

Since  these  functions  are  to  be  provided  as  a part  of  the  given  data, 


two  different  cases,  believed  to  be  typical,  will  be  considered  in  this 
work. 


A A 

First,  we  will  assume  the  given  density  functions  p(a  |a  , B , 

. A A A 

) and  p(j3^  ^ ^ , rrij ) describe  two  normally  distributed 

random  variables,  a and  B , for  all  l in  the  range  of  (m.  , m~] 

Xj  Xj  L Ct 

except  for  SL  - m. , i.  e,  , the  first  line  of  the  object,  where  a and 

1 

0 are  given  to  be  uniformly  distributed. 
ml 

Next,  uniform  statistics  will  be  assigned  to  a and  8 for  all  Si  in 

Xr 

the  range  of  [m^m^]  . In  the  sequel,  a detailed  formulation  of  the 


results  is  presented  for  each  case 
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Since  a Gaussian  probability  density  function  can  be  defined 
completely  through  the  knowledge  of  first  and  second  order  statistics 
of  the  random  variable,  [26],  the  conditional  mean  and  variance 
values  of  a and  B should  be  sufficient  to  describe  p(a  |a  , § ,m 

. A A A 

and  p(g^  | mj ) in  the  Gaussian  case.  The  choices  of 

conditional  mean  and  variance  values  of  a and  8 , m fl  <:/  <:m  are 

ill  2' 

somewhat  arbitrary.  The  motivation  behind  the  valves  chosen  below 
will  be  given  shortly.  Let 


) 


(4.  3.i)  p(a  ! m ) = ~ , 1 <;a  sj 

mj  1 J m^ 

where  J denotes  the  total  number  of  pixels  in  every  line  of  the  image. 
Furthermore,  for  m +1  ^ i <•  m , let 

A u 

(4.  3.2)  '“/.l  ’ 

(4. 3. 3)  Var,aJVrVl'ml)  = 

where  E(*  ) and  Var(*  ) denote  the  mathematical  expectation  and 
variance  operators,  respectively,  and 

(4.3.4)  ns.  i 

ill 

(4.3.5)  L = max  (L  ) 

(4.3.6, 

Similarly  for  (3  , let 

Xj 
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(4.3.7)  P(3  la  * m ) = 

m ^ i 


J-a 


, a ^ P ^ J , 

rrij 


m. 


and,  for  m^fl  £4 


(4.3.8) 

(4.3.9) 


E,B<  K’Vl'  B«-l'  ml)  ‘ B^-l 

Var(BJvvi’B<-i'mi' = • 


where  L „ and  L are  as  defined  in  (4.  3. 4)  and  (4.  3.  5).  From  (4.  3.2)- 
4 

(4.  3. 3)  and  (4.  3. 8)-(4.  3.  9),  then, 


(4.3.10)  p(a  = 


*/2tt  |L  j-L| 


exp 


(4.3.11)  = — 


./Zti|L  -L| 


exp 


- 2 

<YVi>  | 

1 


2i9.rLr 


fc*-  m.  4-1  ^4  ^ m_  and  a.  ^ 0 . 2 J. 

1 2 4 4 

In  the  presence  of  a finely  digitized  (sampled)  image,  [27]  , it 

seems  reasonable  to  assume  the  mean  values  of  a and  B to  be  at 

4 4 

a . and  8 . the  conditional  mean  values  of  a and  B to  be  at 

4-1  4-1  4 4 

A A 

a.  , and  B . , hence  (4.  3.  2)  and  (4,  3.  8). 

4-1  4-1 

In  choosing  the  conditional  variances  of  a and  B , the  flexibility 

Aj  Xj 

of  the  boundary  estimator,  in  the  sense  of  adapting  itself  to  break 
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V 


away  from  bad  estimates,  has  been  our  major  concern.  It  is  intuitive- 
ly desirable  to  choose  the  variances  of  0.^  and  P^  large  when  the 

estimates  a , and  S . are  poor  and  small  when  they  are  good.  In 
l- 1 z-i 

other  words,  we  would  like  to  encourage  the  estimator  to  stay  close 

A A A * 

to  a and  P when  it  is  looking  for  and  P^  only  if  and 
are  good  estimates  of  0^  ^ and  P^  The  choice  of  variances  as  in 
(4  3.3)  and  (4.  3. 9)  is  an  attempt  in  that  direction.  Notice  the  bound- 
ary estimator  will  be  less  "rigid"  in  estimating  and  P^ , if  the 
estimated  width  of  the  object  on  line  .2-1,  i.o.,  is  far  from  the 

maximum  width  of  the  object.  The  maximum  width  of  the  object,  L, 
assumed  approximately  known  in  practice,  was  chosen  as  an  arbitrary 
reference  value. 

A AAA 

With  density  functions  p(a^  |a^_  and  P^'a^'a'^.l'  ^_l,irV 

given  as  in  (43.1.),  (4.3.7),  (4.3.10),  and  (4.3.11),  relationships 


(4.1.6),  (4.1.7),  (4.1.9),  and  (4.1.10)  can  be  written  as 

2 


'4.3.  12) 


(m  - l)J+a  -1 
1 

g(a  ) = 2a“  In  J - 

m,  4mmd 


K(k)  , 


‘1 


k=(m^  - 1 )J+1 


(4.3.13)  g(ajj)  = 


2 - 2 
a (W,> 


W-1)J-hx  -1 


«Li-rw 


E K<k)  + 

k=U-l)J+l 


2 2 » ‘ 
2 a ln^/rT-t-  a ln(L  j-L) 


(m.  -1  )J+P 
i m 


(4.3.14) 


h(P  ) = 2 a ln(J-a  ) + 
ml  ml 


K(k)  , 


k=(m^  - 1 ) J+l 
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(4.3.15)  h(B  ) 
1 


2*2 

° tBi-g4.1> 

A 2 

(L,.rL> 


(i-l)J+B, 


k=(£-l)j+l 


K(k)  + 


Zrr2  !n,/n  + ln(£  ^L)2  , 


where  m1+l  and  y ^ J for  mj  Omitting  the 

constant  terms  which  do  not  affect  the  minimization  of  g(a  ) and  h(0  ), 
•ve  obtain 


(4.3.  16) 


(m  - 1 ) J+a  -1 
1 m. 


z 1 


K(k)  , 


k = (m  j -1  )J+1 


a 2 (a  -a  )2  (-  - 1 ) J+V 1 

(4.3.17)  g(a  ) = - — ’ 2 * 2 

‘ (L  ,-L)2  ' ‘n^.l-W 

k=(^-l)J+l 


(4.3.18) 


(mj-lJJ+g 


h(B  ) = 
ml 


Z 1 • 


k=(mj  -1  )J+1 


a2(P-S  )2  U-MJ+B 

(4.3.19)  h(0)  = 1-*'1  + y»  i 

(L  ,-L)2  “ 

^ k=(£-l  )J+1 


K(k)  + a2  ln(L  -L)2  . 


Computations  of  a,  and  §, . ^ Sm2,  8uch  that  criteria 

(4.  1.11)  is  satisfied  is  now  routine  using  equations  (4.  3. 1 6). (4.  3.  19) 
along  with  the  recursive  procedure  described  in  section  4.1. 

An  alternative  choice  for  the  density  functions  p(a,|a,  .,0  „») 

and  p(0^  |a/,oj_1,  mj)  is,  as  noted  before,  uniform  distribution. 

In  this  case  density  functions  of  ^ and  ^ are  constant  and  can  be 
omitted  out  of  the  minimization  process  (4.1.11).  The  corresponding 


g(a  ) and  h(8)  functions,  from  (4.  1 , 6)  and  (4,  1 . 7),  then,  areas 
l l 

follows . 

(4.3.20)  g(CLg)  = - ^ K(k)  ’ 

k=(/- 1 ) J+l 

(4.3.21)  h(^)  = ^ K(k)  ' 

k=(/-  1 ) J+l 

for  m,  £m„.  Estimates  of  a.  and  8.  can,  then,  be  computed 
12  l l 

recursively  using  (4.  3.  20),  (4.3.21),  and  the  pi  ocedure  described  in 
section  3.  8. 

A comparative  analysis  of  the  above  two  choices  of  distributions 
(Gaussian  and  uniform)  for  and  ^ will  be  performed  in  a later 
section.  Presently,  a few  examples  are  provided  in  the  subsequent 
section  to  illustrate  the  results. 

4.4  Examples 

Several  images  have  been  considered  to  depict  the  results  of  this 
chapter.  Figure  IV.  5 illustrates  the  "original  image"  versions  of 
these  pictures.  Two  of  the  original  images  (square  and  diamond) 
were  simulated  by  computer.  The  third  image  (girl),  was  chosen  to 
represent  a natural  photograph.  All  the  images  are  digital  with  equal 
grid  sizes  of  256  by  256  picture  elements.  The  "observable  image,  " 
in  each  case,  is  obtained  through  determining  the  mean  and  variances 
of  the  original  pictures  and  then  adding  a white  Gaussian  noise  of 
specified  variance  (zero  mean)  to  each  picture.  Figures  IV,  6 and  ^ 
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Figure  IV.  5a.  Original 
Square. 


Noisy  Square 
(S/N  = 1.0). 


Noisy  Diamond 
(S/N  = 1.0). 


Noisy  Girl 
(S/N  = 10.0) 


Figure  IV. 7a.  Noisy  Square 
(S/N  = .6). 


Figure  IV.  7b.  Noisy  Diamond 
(S/N  = .6). 


Figure  IV.  7c.  Noisy  Girl 


0 


IV.  7 represent  two  sets  of  observable  images  with  different  signal- 
to-noise  ratio  values.  An  image  signal -to-noise  ratio,  heretis 


defined  as 


(4.4.  1) 


S Is  signal(original  image)  variance 
N “ noise  variance 


An  arbitrary  segmentation  procedure  was  performed  to  produce 
background,  ab(k).  and  object,  <()(k),  sample  functions  for  each 
image.  The  segmentation  procedure  was  based  on  replacing  the 
object  intensity  values  by  the  maximum  background  grey  level  value 
(forming  the  background  sample)  and  replacing  the  background 
intensity  values  by  the  minimum  object  grey  level  value  (forming  the 
object  sample).  In  general,  an  estimator,  as  described  in  section 
3.5,  is  required  to  perform  the  segmentation  task.  However, 
the  original  images  were  available  here  (not  usually  the  case),  the 
above  arbitrary  technique  was  a more  convenient  procedure. 

Two  sets  of  experiments  were  performed  reflecting  results  of 
sections  4.  1 and  4.2,  respectively.  Statistics  of  and  in  these 
experiments,  were  assumed  Gaussian  as  described  in  section  4.3. 
Figures  IV.  8 and  IV.  9 illustrate  outputs  of  the  boundary  est.mator 
when  values  of  m,  and  rm,  are  given  as  m,  = 1 and  m.,  = 256.  Note, 
no  additional  geometric  information  was  used  to  delete  those  bound 
ary  point  estimates  not  belonging  to  the  object.  Figures  IV.  10  and 
IV.  11  depict  the  results  of  section  4.2  where  locations  of  the  first 
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Figure  IV. 8a. 


Figure  IV. 8b. 


Figure  IV. 8c. 


Square  Boundary. 


Girl  Boundary. 
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Figure  IV. 9a.  Square  Boundary. 


m 


■ 


Figure  IV. 9c.  Girl  Boundary. 


■ 


«*V»  ■“ 


and  last  lines  of  the  object  were  estimated  based  on  statistical 

informations  provided  in  section  3.4.  The  routine  described  in  flow 

chart  of  Figure  IV.  4 was  implemented  to  obtain  estimates  of  m^  and 

m To  insure  that  m.  and  m_  represent  the  maximum  and  minimum 
c l c, 

points  of  the  functions  C(m)  and  A(m),  respectively,  a few  lines 

located  ahead  of  m}  and  m^  were  checked  as  well.  The  number  of 

lines  selected  for  this  purpose  are  denoted  by  integer  constants  ^maX 

and  X in  Figure  IV.  4.  To  keep  the  boundary  estimator  totally 
min 

on-line,  values  of  X and  X . should  not  exceed  the  quantity 

max  min 

(m^-ni^).  For  the  examples  illustrated  here,  values  °f  ^max  anc* 

X , when  applicable,  were  chosen  to  be  15.  No  significant  improve- 
min 

ment  of  the  results  were  noticed  for  larger  values  of  ^max  and  ^m{n* 

Higher  values  of  X and  X may,  however,  better  the  results 
msx  min 

when  the  noise  power  of  the  image  under  consideration  is  higher  than 
those  chosen  here. 

Table  (IV.  A)  summarizes  the  S/N  ratio  values  of  the  observed 

images,  and  the  conjectured  values  of  the  object  maximum  width,  L, 

for  each  picture.  Note,  from  relationships  (4.3.3)  and  (4.3.9), 

variances  of  cl.  and  (3  are  directly  proportional  to  L.  Various 
L l 

starting  and  ending  points  (a  and  0 ) variances  were  considered,  by 

Jc  & 

selecting  different  values  for  L,  to  detect  the  sensitivity  of  the 
boundary  estimator  to  changes  in  variance  values.  Figures  IV.  9c 
and  IV.  12  are  two  such  examples  depicting  the  girl-boundary  for 

66 


Chapter  V 

DISCUSSION  AND  CONCLUSION 


\\ 

:v> 

*>r  * 


i'j 


in  this  chapter,  we  will  concern  ourselves  with  analysis  of  the 

boundary  estimator.  The  quality  of  the  estimator  outputs,  as 

1 • ruantpr  IV  will  be  discussed, 

demonstrated  through  examples  in  Chapter  , 

Possible  ways  of  improvement  will  he  examined.  Extensions  of  the 
estimator  to  multiobject  images,  and  areas  of  future  research 

explored. 

5.1  Analysis 

Referring  to  expression  (3.6.30),  i.e., 


(5.1.1)  min 

W,  W 


-2 a2  In  pfm^nij)  - 2a  ln  p(m^  + 

m2  | 
^ [T(w£)  - 2o2  lnp(w£|w/_1,m1)]|  . 

» _ 


£-m 
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It  i8  evident  that  the  boundary  estimator  basically  capitalises  on  two 

characteristics  of  the  image,  namely : 

u The  amount  of  contract  between  the  object  and  the  back- 

ground,  and 

ii)  The  statistics  of  the  object  boundary. 

The  contribution  of  the  former  is  represented  in  (S.5.U 

m0 


(5.1.2) 


^ T(w  ) . 
£=ml  l 
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and  that  of  the  latter  is  represented  by 


Z 2 ^ 

(5.1.3)  2a2  In  p(m2|m1)  + 2a  lnpfm^  + Za  ^ In  p(w^  l , m1 ). 

^=m1 

Two  types  of  statistics  were  chosen  for  the  object  boundary  points 

a and  0 , namely,  Gaussian  and  uniform.  The  boundary  estimator 
Jt  f 

designed  based  on  the  latter  type  of  statistics,  as  is  clear  from 
(4.3.20)  and  (4.3.21),  considers  only  the  image  contrast  in  locating 
the  object  boundary  . Intuitively,  then,  it  should  be  suitable  for  high 
contrast  (such  as  binary)  images. 

The  boundary  estimator  based  on  Gaussian  statistics,  on  the 
other  hand,  considers  both  the  image  contrast  and  the  boundary 
statistics  in  locating  the  object  boundary.  This  is  evident  from 
(4.  3.  16)-(4.  3.  19).  Varying  the  variances  of  and  in  this  case, 
one  can  emphasize  dependence  of  the  boundary  estimator  on  either 
image  contrast  or  object  statistics.  This  estimator,  therefore,  seems 
to  be  better  suited  for  images  whose  object  boundaries  are  mostly 
due  to  textural  dissimilarities  rather  than  just  contrast. 

Based  on  the  above  analysis,  choice  of  the  variances  of  and  p 
become  crucial  in  design  of  the  boundary  estimator  based  on  Gaussian 
statistics.  Locally  optimum  variances  for  and  ^ (differing  from 
picture  to  picture  or,  in  a more  general  setting,  differing  among 
classes  of  pictures),  therefore,  should  exist.  Determination  of  such 
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optimal  variances,  however,  is  not  a trivial  problem. 

Our  choice  of  variances  as  in  (4.3.3)  and  (4.3.9),  although 
intuitively  motivated,  is  not  claimed  to  be  optimum.  But,  based  on 
the  experimental  results,  depicted  in  section  4.4,  it  seems  to  have 
been  a suitable  choice. 

Since  a method  of  selecting  optimum  variance  values  was  not 
established,  other  forms  of  variances  could  result  in  better  (or 
worse)  estimator  outputs.  In  fact,  an  alternate  technique  of  defining 
the  conditional  variances  of  a£  and  will  be  suggested  by  ourselves 
in  the  next  section.  It  will  be  shown,  however,  that  this  alternative 
definition  does  not  always  yield  superior  results.  It  is  suspected, 
therefore,  that  until  a consistant  method  of  finding  the  optimum 
variances  is  developed,  different  variance  values  will  carry  different 
tradeoffs. 

5.2  Possible  Ways  of  Improvement 

A refinement  of  the  boundary  estimator  can  be  achieved  if  one 
believes  that  majority  of  the  objects  within  typical  images  possess 
connected  boundaries. 

Recall,  in  section  4.3,  it  was  assumed  the  conditional  mean 

values  of  a and  3 are  at  a and  (3  .,  respectively.  This  assump- 

l i i- 1 l - -1 

tion  is  specially  valid  if  the  object  boundary  forms  a connected  set. 

However,  over  there,  in  order  to  not  bias  the  boundary  estimator 
toward  connected  boundaries,  the  variances  of  and  3^  were 
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allowed  to  vary  freely.  To  capitalize  on  the  connectiveness  of  the 

boundary,  we  shall  restrict  the  magnitudes  of  the  variances  of  ol^  and 

3 to  be  very  small.  Note  that  the  flexibility  of  the  estimator  to 
i 

compensate  for  poor  estimates  of  a and  (3-  should  still  be  one  of  our 
major  concerns.  In  other  words,  utilization  of  connectivity  property 
should  not  unduely  obstruct  the  necessary  agility  of  the  boundary 
estimator.  The  adverse  effects  of  such  oversight  will  be  shown  by  an 
example  shortly.  Note  that,  by  utilizing  the  connectiveness  of  the 
object  boundary,  we  do  not  expect  the  boundary  estimator  to  yield  a 
connected  boundary. 

A technique  implemented  to  improve  the  output  of  the  boundary 
estimator  visually  based  on  the  connectiveness  of  the  object  boundary 
is  described  below.  Let 

I aCL  U '^-l"L'  SC1' 


(5.2.1)  Var(a^  la^  j,  j,  nij)  = 


1 

. A .2 

if 

i A t2 

|Lg_rLl  >c!  * 

2 . a . 2. 

where  a is  an  arbitrary  small  number  (comparative  to  |L  ,-L|  ) 
a 

and  Cj  is  an  arbitrary  threshold.  Similarly,  let 

A A A ^ 

2 

if 

(5.2,2)  Va “ 1 

i a 1 2 

if 

I^i-l|2>c2, 

2 2 
where  a and  C_  are  defined  analogous  to  a and  C.,  respectively. 
B 2 a 1 
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Incorporation  of  (5,2,1)  and  (5.  2.2)  into  boundary  estimation 

algorithms  described  in  sections  4.  1 and  4.2  are  easy  matters. 

2 2 

However  selection  of  optimal  values  for  a , n„,  and  the  thresholds 

a B 

Cj  and  is  not  trivial. 

Tew  examples  illustrative  of  the  effects  of  connectivity  modifica- 
tion in  the  boundary  estimation  algorithm,  are  presented  here  for  the 
sake  of  clarity.  Figure  V,  1 depicts  the  case  where 

2 _ 2 

" “ <Tp  = .1 

a p 


C1  = C2  = 10‘ 

Notice  the  points  forming  the  boundary  are  more  centered  and  show 
less  fluctuations  in  this  figure  as  compared  with,  for  example, 
Figure  IV.  8,  The  signal  to  noise  ratio  and  other  pertinent  values  of 
Figure  V.  1 are  the  same  rs  those  of  Figure  IV.  8. 

Figure  V.  2 has  been  submitted  to  illustrate  the  case  where 
inclusion  of  connectivity  property  has  overwhelmed  the  flexibility  of 
the  boundary  estimator  to  a degree  of  losing  the  boundary  altogether. 
Pertinent  parameter  values  of  this  figure  are  identical  with  those  of 
Figure  IV.  9. 

Significant  improvements  in  the  output  of  the  boundary  estimator 
can  be  expected  if  one  is  ready  to  . pecialize  the  estimator  further. 
For  example,  given  that  the  objects  considered  will  always  have 
circular  shapes,  will  improve  the  final  results  considerably. 
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Availability  of  such  informations,  however,  cannot  be  visualized  as 
practical  if  one  is  to  develop  generally  applicable  boundary  estimators. 
5.  3 Extensions  of  the  Estimator  to  Multiobject  Images 

As  mentioned  in  section  5.1,  the  boundary  estimator  basically 
capitalizes  on  two  characteristics  of  the  image,  namely,  the  amount 
of  object-background  contract  and  the  statistics  of  object  boundary. 

The  contrast  is  an  inherent  property  of  the  image.  The  statistics, 
however,  can  be  manipulated  to  improve  the  results.  For  the 
Gaussian  statistics  chosen  in  this  work,  the  variances  of  and 
were  arbitrary.  A small  variance  would  instruct  the  boundary  esti- 
mator to  emphasize  its  dependence  on  the  statist  cs  of  the  object 
boundary,  whereas,  a large  variance  would  encourage  the  estimator 
to  rely  mainly  on  the  amount  of  contract  between  the  object  and  back- 
ground. This  dichotomy  of  the  boundary  estimator  suggests  a method 

of  obtaining  boundaries  for  multi-ODject  images. 

Assuming  the  variances  of  0/  and  are  suitably  defined,  for 
example  as  in  (4.  3.  3)  and  (4.  3.9),  ^r  each  object  in  a multi-object 
image,  a classification  of  the  objects  is  made  based  on  their 
maximum  size.  This  is  possible  since  the  variances  are  directly 
proportional  to  the  objects  maximum  sizes.  The  boundary  estimator 
is  then  biased  to  look  for  an  object  with  maximum  size  L.,  where  i 
denotes  the  i-  object.  Once  this  object  is  located  (its  boundary 
determined),  its  detail,  represented  by  the  i-  object  sample  function, 


: 


is  replaced  by  the  background  sample  function.  The  procedure  is 
then  repeated  until  the  boundary  of  the  last  object  is  determined. 

The  above  suggested  technique  is  based  on  the  replacement 
processing  concept  delineated  previously.  It  is  mainly  suitable  for 
images  with  nonoverlapping  objects.  Furthermore,  the  segmentation 
procedure  required  to  determine  various  objects  and  background 
sample  functions  is  a crucial  operation  here  and  it  should  be  per- 
formed based  on  techniques  described  in  section  3,  5. 

As  a by  product  of  considering  multi-object  images,  we  observe 
that  the  optimum  variance  functions  of  a and  0 should  depend  on 
some  characteristic  of  the  object  in  the  image  so  as  to  differentiate 
it  from  other  objects.  This  is  another  readon,  not  possible  to  explain 

until  now,  that  we  defined  the  variances  of  a and  0 as  functions  of 

/ l 

the  object  maximum  width  in  (4.  3.  3)  and  (4.  3. 9). 

Suitability  and  verification  of  the  above  suggested  procedure  to 
obtain  boundaries  of  multi-object  images  is  left  as  a future  research 
topic.  Other  topics  meriting  further  research  are  discussed  in  the 
following  section. 

5.4  Areas  of  Future  Research 

Digital  image  processing  techniques,  as  opposed  to  analog 
(optical)  techniques,  are  generally  based  on  utilization  of  digital 
computers.  As  a result,  development  of  efficient  computational 
algorithms,  aimed  at  alleviating  the  amount  of  time  and  storage 


\ 
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required  to  process  an  image,  have  been  given  special  attention  in  the 
literature  r5-7l.  Recursive  computational  procedures,  usually, 
retain  the  above  mentioned  desired  features  for  implementation  on  a 
computer. 

The  proposed  recursive  solution  of  the  minimization  process 
(3.  6.  30),  delineated  in  Chapter  IV,  was  an  attempt  to  produce  a 
computationally  efficient  algorithm  for  the  boundary  estimator. 
Forcing  a recursive  solution  on  (3.6.30),  however,  may  have  affected 
the  results  adversely.  Although  satisfactory  experimental  results 
favored  the  recursive  solution,  implementation  of  parallel  computers, 
for  processing  the  minimization  (3.  6.  30),  could  clearly  yield 
improved  estimates  of  the  boundary.  An  efficient  algorithm  appli- 
cable to  computers  with  parallel  processing  capabilities,  therefore, 
should  be  considered  in  the  future  when  such  computers  are  readily 
available. 

Accepting  utilization  of  sequential  computers  as  the  most 

efficient  choice  at  present,  and  furthermore,  the  Gaussian  statistics 

as  reasonable  choice  of  density  functions  for  a and  B , development 

of  a method  to  determine  optimum  variance  values  for  a and  B is 

l l 

another  area  meriting  further  research. 

Appropriate  extensions  of  the  boundary  estimator  to  multi- 
object images  is  another  interesting  problem.  An  intuitively 

justified  procedure,  based  on  available  geometric  information  about 

79 


the  objects  within  the  image  (such  as  their  maximum  sizes)  was 
described  in  section  5.  3.  Development  of  a boundary  estimator 
based  on  the  replacement  processing  concept  is,  however,  a more 
direct  approach  to  derive  a multi-object  boundary  estimator.  Such  a 
procedure  would  require  explicit  representation  of  y.  's,  defined  in 
section  2.7,  in  terms  of  the  boundary  points  of  each  object.  Further 
work  to  explore  the  possibilities  of  such  representations  for  y.'s 
seems,  henceforth,  to  be  worthwhile. 

5.  5 Conclusion 

The  feasibility  of  resolving  boundary  determination  problems 


through  existing  estimation  concepts  was  established.  An  imple- 
mentable  boundary  estimator,  based  on  a combination  of  deterministic 
and  probabilistic  information  pertaining  to  the  image,  was  developed 
and  its  performance  was  satisfactorily  tested  through  a few  examples. 
The  boundary  estimator  was  designed  to  be  recursive,  hence,  making 
it  computationally  attractive.  The  recursive  processing  of  images  is 
specially  desirable  because  of  the  enormous  amount  of  data  and 
computations  involved.  Finally,  although  the  boundary  determination 


procedure  developed  in  this  work  is  not  claimed  to  be  superior  to 
other  existing  techniques  in  all  cases,  its  methodological  formulation 
is  hoped  to  generate  further  interest  and  insight  into  design  of  future 


boundary  determination  techniques. 
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